Pupil detection in the wild: An evaluation of the state of the art in mobile head-mounted eye tracking

Robust and accurate detection of the pupil position is a key building block for head-mounted eye tracking and prerequisite for applications on top, such as gaze-based humancomputer interaction or attention analysis. Despite a large body of work, detecting the pupil in images recorded under real-world conditions is challenging given significant variability in the eye appearance (e.g., illumination, reflections, occlusions, etc.), individual differences in eye physiology, as well as other sources of noise, such as contact lenses or make-up. In this paper we review six state-of-the-art pupil detection methods, namely ElSe [6], ExCuSe [5], Pupil Labs [16], SET [8], Starburst [18], and W. Fuhl Perception Engineering Group, University of Tübingen, Germany E-mail: [email protected] M. Tonsen Perceptual User Interfaces Group, Max Planck Institute for Informatics, Germany E-mail: [email protected] A. Bulling Perceptual User Interfaces Group, Max Planck Institute for Informatics, Germany E-mail: [email protected] E. Kasneci Perception Engineering Group, University of Tübingen, Germany E-mail: [email protected] Świrski [30]. We compare their performance on a large-scale dataset consisting of 225,569 annotated eye images taken from four publicly available datasets. Our experimental results show that the algorithm ElSe [6] outperforms other pupil detection methods by a large margin, offering thus robust and accurate pupil positions on challenging everyday eye images.